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We consider continuous time random walks (CTRW) for open systems that exchange energy and 
matter with multiple reservoirs. Each waiting time distribution (WTD) for times between steps 
is characterized by a positive parameter a, which is set to a = 1 if it decays at least as fast as 
t~ 2 at long times and therefore has a finite first moment. A WTD with a < 1 decays as 
A fluctuation theorem for the trajectory quantity R, defined as the logarithm of the ratio of the 
probability of a trajectory and the probability of the time reversed trajectory, holds for any CTRW. 
However, R can be identified as a trajectory entropy change only if the WTDs have a — 1 and satisfy 
separability (also called "direction time independence"). For nonseparable WTDs with a = 1, R 
can only be identified as a trajectory entropy change at long times, and a fluctuation theorem for the 
entropy change then only holds at long times. For WTDs with < a < 1 no meaningful fluctuation 
theorem can be derived. We also show that the (experimentally accessible) nth moments of the 
energy and matter transfers between the system and a given reservoir grow as t na at long times. 

PACS numbers: 



INTRODUCTION 



It has long been clearly understood that the state- 
ment of the Second Law of Thermodynamics concern- 
ing the increase in entropy in an isolated system as it 
goes to equilibrium refers only to the average behavior, 
but this was sufficient as long as one dealt only with 
macroscopic systems characterized by extremely narrow 
ensemble distributions with fluctuations that were essen- 
tially never observed. More recently, with the ability to 
quantitatively monitor systems on the extremely small 
scales of single molecules and quantum dots, it is pos- 
sible to study fluctuations around the average behavior. 
Fluctuation theorems that hold arbitrarily far from equi- 
librium have thus become subject to experimental verifi- 
cation [E H, H, 0, [E Hi ■ These theorems in general deal 
with the ratio of the probabilities of a given system tra- 
jectory and that of its time reversed trajectory, either as 
the system goes to equilibrium or as it evolves to a steady 
state under the action of nonequilibrium constraints im- 
posed on the system. From this one can calculate, for 
example, the relative probabilities that the entropy of an 
isolated system away from thermodynamic equilibrium 
will spontaneously increase or decrease over a given pe- 
riod of time. The ratio is essentially infinite in a macro- 
scopic system away from equilibrium and is unity due 
to fluctuations in equilibrium, but in sufficiently small 
systems away from equilibrium it is merely large (and 
experimentally accessible) rather than infinite. 

Fluctuation theorems can take different forms de- 



pending on the specific problem under consideration, 
but they are all ultimately connected to the probabilis- 
tic asymmetry of system trajectories and time reversed 
trajectories. Equilibrium corresponds to the situation 
where the symmetry is restored as stated by the prin- 
ciple of microreversibility. Fluctuation theorems have 
been formulated for a wide range of dynamics such 
as driven Hamiltonian dynamics [8|, H E3] , stochastic 
dynamics [HI, El, l^tlJi, El Ell: deterministic ther- 
mostated dynamics 
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, and even quantum dynam- 
Here we focus on stochastic 
dynamics, in an effort to explore the validity of fluctua- 
tion theorems beyond the stochastic dynamics that have 
been considered to date. 

In this narrower context of stochastic dynamics, most 
previous studies of fluctuation theorems have focused 
on systems described by Markovian master equations 
or Fokker-Plank equations. Recently there have been 
some efforts to investigate fluctuation theorems for sys- 
tems described by nonlinear generalized Langevin equa- 
tions [25L H(| with an external driving force as a nonequi- 
librium constraint. Our focus is on nonequilibrium 
systems described by continuous time random walks 
(CTRW) [H EH, M, M, M, HI in which transitions be- 
tween microscopic states may be caused by more than 
one mechanism. The nonequilibirum constraint is im- 
posed when these mechanisms have different statistical 
properties such as, for example, through contact with 
two heat baths maintained at different temperatures. In 
general, identifying such nonequilibrium constraints may 
itself be complicated [HI, US] , and we will here explicitly 
point to these differences. 

We pose the following question: What properties of a 
CTRW are necessary for an entropy fluctuation theorem 
to be valid under such nonequilibrium constraints? We 
note, for example, that CTRWs are known to display ag- 
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ing [34|, [H, H|| as well as nonergodic phenomena [13, H|| 
which may significantly alter the behavior of the system 
under time reversal and prevent a fluctuation theorem 
from being satisfied. At the same time, CTRWs under 
certain conditions reduce to Markovian master equations 
which are known to satisfy fluctuation theorems. CTRWs 
therefore provide a good framework to study the validity 
of fluctuation theorems. In particular, our results will 
hopefully contribute clarification to recent observations 
of anomalous statistics in the nonequilibrium fluctuations 
of single molecules and quantum dots [1^, EL 52 • 

A second purpose of this paper is the formulation of a 
general framework for the calculation of (experimentally 
accessible) counting statistics of events associated with 
a given mechanism. Examples of such events might in- 
volve particle or energy transfer. To accomplish this we 
use a method based on the propagation of the generating 
function associated with the probability distribution of 
the events, in the spirit of the method used for Marko- 
vian master equations [HI, This will allow us to 
investigate the long-time behavior of the moments of the 
distribution associated with the counting statistics. 

Our basic CTRW model is constructed as follows. 
We consider a stochastic dynamics between microscopic 
states m of a system with a finite number of states. The 
transitions between states may be due to different mech- 
anisms v. For example, we will subsequently consider a 
system in which each microscopic state to is character- 
ized by a number N m of particles and an energy e m , and 
where the transitions between the m's are triggered by 
different reservoirs (heat baths) v. Suppose that the sys- 
tem arrives at state m' at a given time and that its next 
jump is to state m at a time t later via mechanism v. The 
distribution of waiting times (WTD) for this to occur is 

denoted by Vw«'(*)> w ^ tn other related quantities spec- 
ified in more detail subsequently. We focus on waiting 
time distributions whose long-time behavior is reflected 
in the small-s Laplace transform 

i) {v) (s) = P (v) , - B [v) s a (1) 

Vmrn'\°) ~ 1 mm' D mm' b ' \ L 1 

where f(s) = J^°dte- St f(t) and < a < 1. The B^ m , 
are elements of an arbitrary matrix. A detailed discussion 
surrounding this choice can be found in [43|. When < 
a < 1 the long-time decay of the WTDs is then of the 
power law form ipmln' CO ~ When a = 1 the decay 

is at least as fast as 1/t 2 but may be faster. 

In Sec.|lT]we present the CTRW model for an open sys- 
tem driven by different mechanisms described by different 
statistical properties, and formally express the probabil- 
ity that the system is in state m at time t. In Sec. IIIII wc 
derive the generalized master equation satisfied by this 
probability and study its long time behavior. In Sec. IIVI 
we present a generating function formalism to calculate 
the probability distribution of heat and matter transfers 
which is used to study the long time behavior of the mo- 
ments of the distribution. The principal results of this 
work, namely, the conditions for the validity of fluctua- 



tion theorems, are presented in Sec. [V] In particular, we 
show that fluctuation theorems for the entropy change 
can only be obtained if a — 1, that is, if the WTDs de- 
cay at least as fast as t~ 2 at long times. Furthermore, 
even in this case the entropy change can be expressed as 
a familiar ratio of the probability of a trajectory and its 
time reversed trajectory only if the WTDs satisfy con- 
straints of separability. A summary of results and some 
concluding remarks are presented in Sec. IVI1 

II. CONTINUOUS TIME RANDOM WALKS 
FOR OPEN SYSTEMS 

Our goal in this section is to construct the probabil- 
ity that the system will be found in a particular state 
at time t. Suppose that the system arrives at state to' 
at time zero, and that its next jump is to state m at 
time t via mechanism v. The waiting time distribution 

(WTD) VwL' W f° r this event introduced earlier satisfies 
the normalization condition 

/■OO 

/ drJ2^l(r)=l, (2) 

*'° m,v 

For convenience, we define ipmm(T) = 0. The probability 
that no transition occurs up to time t after arrival at to' 
at time zero is 

/oo 
ru,L> - 

= 1-E fdr^Ur). (3) 

m,v ,Jo 

We see that by construction <j) m i (oo) = 0, that is, a jump 
eventually occurs with certainty. We define the auxiliary 
distributions 

^?(t) =$>£!'(*). vw(*) = E^(*). (4) 

rn v 

tp^L; (t) is the waiting time distribution of the first jump 
from state m' to any other state via a mechanism u, 
and il> m '(t) is the waiting time distribution of the first 
jump from state m! to any other state regardless of the 
mechanism, given that arrival at m! occurred at time 
zero. We also define 

/•oo 

P%1= dr^ m ,{r), P mm ^J2 P ^- (5) 

Here Pj^^i is the probability that, being at to', the next 
jump will be from state m! to m via mechanism is, and 
Pmm' is the probability that the jump will be from to' to 
to irrespective of the mechanism. Note that by definition 
P mm = 0. We finally define the probability f^, that the 
next jump from rn! will be due to mechanism v, 

r, = Vp M ,. (6) 

J rn' — / j mm' v "/ 
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The normalization condition {2} implies 

/>oo 

/ dm/, m (Jt) = l, 5^Pw=l, $3/^ = 1. (7) 

*'° mi/ 

The determining feature of the problem for our pur- 
poses is the behavior of the first moment of the waiting 

time distribution ip^ m i it) and, in particular, whether it 
is finite or infinite. This first moment is just the average 
time that the system remains in state ml before jumping 
to m via mechanism v: 



t 



Associated mean waiting times are given by 

/ j mm' ' m / j m 



(8) 



(9) 



The first is the average time that the system remains in 
state ml without jumping anywhere else via mechanism 
v. The second is the average time that the system re- 
mains at m! without making any jumps at all by any 
mechanism. If a < 1, all moments of the waiting time 
distribution (including the first moments or mean waiting 
times) are divergent, whereas for a = 1 the first moments 
Snm' are nm te. In this case, from (Q} and (JSJ) it follows 
that B {v) ,=& } ,. 

mm' mm' 

Suppose that we begin our observations at time t = 0, 
at which time we find the system in state ml. Since in 
general we may not know when the jump occurred that 
brought the system to that state, we need to distinguish 
the waiting time distribution of the first jump after time 
zero from that of subsequent jumps. We mark this first 
waiting time distribution with a prime, The 
probability that no transition away from ml occurs up 
to time t must be similarly distinguished, 4>' m (t). The 
primed functions are equal to the unprimed ones only if 
a jump occurred exactly at time zero or if the WTDs 
decay exponentially. If there is no information about 
when the last jump before time t — occurred, then the 
primed functions can be related to the unprimed ones 
only if the mean waiting times t^L, are finite. In this 
case, an average over the uncertain past yields 



HmJ^dt^dT^Ut-T) 



dTib (v) At 



(10) 



Note that summing Eq. (|10[) over m and v and using 
Eq. © leads to 



'(*) 



Similarly, 



,/ M JT ( r ) 
<P m '{t) = ■ 



(12) 



It is straightforward to construct an integral equation 
for p m {t), the probability that the system is in state m 
at time t. For this purpose we also define T] m (t), the 
probability that the system jumps onto state m at time 
t. The following integral CTRW relations are evident [27], 

HI!! [II [SI: 



m' ,v 

+ E f^Ut-r^m'ir), (13) 



and 



Pm {t) = <p' m (t)p m (0) + / dr(j} m {t - r)r] m {r). (14) 

JQ 

Since these are convolutions, it is easiest to solve for the 
Laplace transform p m (s) of the desired probability p m (t). 
The Laplace transforms of these two relations are 

Vm(s) = J2 (^mi( S )P™'(0)+^L( S )^( S )), (15) 



and 



Pm{s) = 4>' m (s)p m (0) + 4>m(s)fjm(s). (16) 



The solution is most neatly expressed in terms of the 
matrices $ and ^ with matrix elements 

[*(s)]mm' =i>'m, m '(s), [$(s)] mm ' = 6 mm < (ji> m (s) , (17) 

and the vectors 1 77(5) ) and \p(s)) with elements fj m (s) and 
p m {s). The solution of Eq. (fH))) is 

\f ] {s)) = {l-^{s))- l V(s)\ P m, (18) 



where / is the identity matrix. Using (|16|) . the formal 
solution of the CTRW then is 



(11) 



\~p{s))= U'{s) + ^{ S ){l-^{ S ))-^'{s) |p(0)>. (19) 



III. GENERALIZED MASTER EQUATION 

In this section we construct the generalized master 
equation for the probability that the system is in state 
m at time t. This equation facilitates the exploration of 
the behavior of this probability at long times. Using the 
Laplace transform of ([3]), 

4>m (s) = {5mm' ~ 4>m'm{s)) = ~ (l - i> m (s)) , (20) 
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we can rewrite (ITBl as 



p m (s) = <t>'(s)p m (0) + - fjm(s) 
s 



/ j t 1TL TTL 



(21) 

Inserting (fl~5"|) in the second term of (f2Tj) and using 
Eq. (TIB)) , we obtain 



sp m (s) - p TO (0) = T{s) 



where the transition matrix elements are given by 

iy) 



W y "> As) 

mm' \ ) 



4>m' ( s ) 



(22) 



(23) 



and 



i(s) = Sp.)(U')-^WW(o) 

-W% m (s)$ m (s) - 4>M)Pm(0)). (24) 



The inhomogeneous term X(s) in Eq. (|22[) thus depends 
on the initial condition. It vanishes if a jump occurs at 
time zero or if the waiting time distributions are exponen- 
tial because then (f>' m (t) — (f> m (t). Upon inverse Laplace 
transformation we arrive at the generalized master equa- 
tion 



— i ..Jo 



X ( W^W^t - r) - W^ m {r)p m {t - T) 



(25) 

The generalized master equation is clearly non- 
Markovian unless W^ m '(s) is independent of s. This oc- 
curs, for example, for separable distributions (t) — 
P mli> i>m>{t) with %j) m (t) = e~*/ tm /t m . Indeed, in this 
ceseW^ m ,(s) = P^ nl /t ml . 

Of interest for our purposes is the long-time behavior 
of the probability p m (t). Here we distinguish the case 
a = 1, associated with finite mean waiting times, from 
the case < a < 1, associated with divergent mean 
waiting times. 

A. Long time behavior for a — 1 

Consider first the long time behavior of the generalized 
master equation in the case a = 1. From Eq. (|20[) it 
follows that 



4>m(s) = B m s c 

s— >0 



(26) 



where B m — Y^ m ' v ^m'm- Since it follows from this 
result and from Eq. |T]) that B mm i = t mm ' and B m = t rn , 
Eq. ([23]) then immediately leads to 



W w ,(0) = limW^' ,(s) 

mm,' \ ' s — >q mm ^ ' 



,(0) P 

■ ram' \ / i 



-(0) 



(27) 



Since Hm s _ ta (4> m /(s) — (j>' m ,(s)) is constant when a = 1, 
we find that lim s _>oI(s) is also constant [see Eq. (|24p]. 
Therefore, using the final value theorem /(oo) = 
lim s ^ s /( s ) (Hi IH|, we find that 



limJ(t) = 0, lim W%l(t) = 0. 



(28) 



This means that at long times, the generalized master 
equation behaves like the Markovian master equation 

Pm(t) = £ fei'WPm'W - W^ m (0) Pm (t)). (29) 



Defining the rate matrix V = ^ u where 



, \ P {u) 

— ram' 
mm' td 

•mm — / j v m'm' 

m' (^m) 



for m =/= m 

r{u) 



(30) 



we can rewrite (|2"9")l as = V|/j(t)). Using the 

Perron- Frobenious theorem, all eigenvalues of V are neg- 
ative aside from one which is zero. The probability p m (t) 
therefore decays exponentially to a steady state solution 
Pm that obeys the condition 



0*11' (0)/C - W%? m (0)/C) =0. (31) 



The steady state solution corresponds to equilibrium if 
the detailed balance condition 



w [v) ,(ow oq , = w l 7 row 

" mm'\ Irm' m'm\ lr<. 



(") 



(32) 



is satisfied, that is, if all fluxes between pairs of states 
associated with the different mechanisms v become zero 
at equilibrium. This would not be possible if the long- 
time statistics of the different mechanisms were different. 
If the detailed balance condition is not satisfied, then the 
solution p s mm is a nonequilibrium steady-state. 

A useful connection to thermodynamics is provided if 
we consider that each state m has a given energy e m and 
number of particles N m and that each different mecha- 
nism v inducing transitions between states corresponds 
to a given reservoir with a given temperature and 
chemical potential p, v . We then assume that 



H> M ,(0) 

mm' V / 

W W ) (0) 

m'm\ ) 



= exp{- ) 9 I/ (e ri 



+ p u fi v (N m - N m >)}. 



(33) 
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Equation (|32|) holds only if all the (3 v s and p v s are equal. 
In this case the equilibrium distribution correspond to 
the grand canonical ensemble. If the /3„s and fi^a are 
different, the steady state is a non-equilibrium steady 
state that obeys Eq. (|3Tj) . 



B. 



Long time behavior for < a < 1 



When < a < 1, we must separately specify the sta- 
tistical properties of the waiting time distribution for the 
first jump after t = 0. We choose <j>' m (s) = <j) m {s) because 
other choices add only further complications but little of 
general interest to our specific problem. The inhomoge- 
neous initial condition term then drops out, and for small 
s, using l[30|. Eq. ([22]) becomes 



sp m {s) - p m (0) 



/ , v rnm' b P" 



-(«). (34) 



Using the rules of fractional calculus [44| , this equation 
can be written in the time domain as 



Jt p m (t) 



/ , v mm' 



D}- a Pm ,(t), 



(35) 



where the Riemann-Liouville fractional integral is given 
by 



qD\ a p m '{t) 



1 



r(a) dt 



dTit-rr^p^ir). (36) 



If the matrices with elements V^^, can be diagonalized 
and the eigenvalues Vi (which are all negative or zero) are 
non-degenerate, the solution of Eq. (f35|) can be written 
as a linear combination of solutions of 



- Pi {t) = Vi Dl- a Pi {t). 



(37) 



The solution of this equation is the Mittag-Leffier func- 
tion fiaH'A) ), where r = (— i^) 1 /" (see Appendix B 
of Ref. |44|)- At long times the Mittag-Leffier function 
decays as a power law, 

E a (-(t/rr)~ f (i/ T )<T(l - a)) (38) 

(at short times it behaves as a stretched exponential, 
E a (-(t/r) a ) ~ exp ( - S% T )\ ))■ Thus the general so- 



ex P I r(i+ Q ) 

lution of the generalized master equation is a linear com- 
bination of Mittag-Leffier functions, and the probability 
Pm{t) decays toward the zero eigenvalue node as a power 
law. 



IV. COUNTING STATISTICS 

Although our ultimate goal is to establish conditions 
under which fluctuation theorems are valid for systems 



whose dynamics are described by CTRWs, we first con- 
sider the counting statistics for such a system. These 
statistics are interesting because they are experimentally 
accessible, and this analysis leads to some definitions that 
are useful in the discussion of fluctuation theorems. 

Consider a system described by the CTRW of Sec. [TT] 
where each microscopic state m has a given number of 
particles N m and an energy e m , and where the allowed 
transitions between pairs of states are due to different 
mechanisms v, each corresponding to an reservoir v. We 
want to calculate the probability P({AE ( ^}, {AN^}, t) 
that an energy transfer AE^ and a matter transfer 
AN^ occurs between the system and the reservoir v 
during time t. We define the set of parameters 7 = 
{{le^}, {7m' 1 }) and the generating function 

/oo 
-00 
00 

x P({AE^},{AN^},t) 

{AJV(">} = -oo 

x exp [i( 7 MabM + 7 MAJV<"))] . (39) 

The probability can be recovered from the generating 
function using 



roc 1 Ju) r -z7T ,11/; 

P({AE^},{AN^},t) = {^-} {^} 

J-00 27r Jo 27r 

x exp {-i(AEW~,M + AjVM 7 M)}G(i7, t) . (40) 

Derivatives of the generating function with respect to 
the elements of 7 evaluated at 7 = gives the moments 
of the distribution of this process. 



» 



We define 

VW'(7iU 



(41) 



which is the WTD matrix whose elements associated 
with a transition caused by mechanism v are weighted 

by the exponential of 7 i ( 7 m^) times the change of en- 
ergy (matter) that this transition induces. We note that 
^(7 = 0,t) = ^(t). To evaluate the generating func- 
tion and the associated moments, we replace the WTD 
b Y SB) in the CTRW lp]l and (fl4|). and thus 

obtain 



(42) 



E 



and 



Pm(l,t) = <j)' m (t)p m {Q) + / dT(f> m (t ~ r)?7 m (7,r) .(43) 

Jo 
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By doing so, we are weighting the probability of all the 
trajectories of length t ending up in the state m and 
along which a transfer of energy (matter) between the 
system and the reservoir v occurs, by the exponential of 



7. 



ilm ) times this energy (matter) transfer. By sum- 



ming over all final states m, we reconstruct the generating 
function EHl) as 



(44) 



G( 7 ,t) = (/|p(7,*)> =5>m(7,*) . 



where |7) is the unit vector. Proceeding as in Sec. [Til the 
formal solution of (|42|) and 143 j) in Laplace space leads 
to the general solution for the generating function 

G( 7 ,.s) (45) 

= </| (!'(*) + !(«)(/ - l( 7) a)) - 1 4'( 7 , s)) \p(0)) . 



If ((4~5|) can be evaluated and inverse Laplace trans- 
formed, it provides the full statistics of the energy and 
matter transfer for a finite time interval. This is often 
a difficult task, and one therefore often focuses on the 
long-time behavior. This behavior is accessed through 
the solution (|4"S")1 and also through the equation of mo- 
tion for the generating function, which can be deduced 
by proceeding in the same way as in Sec. IIIII when deriv- 
ing the generalized master equation from (j4"2|) and (|4"5]l . 
Defining 



4> M <(7,s) 

Tram' V [ 7 / 
<t>m>(s) 



we find 



i Jo 



(46) 



(47) 



x ( W%1 (7, r) Pm , (7, t - r) - W%) m (r)p m (7, t - r) 



where 



= E(^w(-y,*)(^m'(*)-0m'(*))Pm'(O) 



column by the sum of all the columns of the matrix (the 
determinant is not affected by replacing a column by a 
linear combination of it with other columns) , which only 
contains zeros since ^2 m i^ m Pm'm = 1 (the determinant 
of a matrix with a zero column is zero) . To lowest order 
in s, the determinant behaves like ~ s a . This means that 

at small s, (/ — ^(s)) 1 s~ a . Using the long time 
behavior of the WTD as expressed in ((TJ) and ([26]) , and 

using (|4"S")1 , we thus see that 6(7 = 0, s) s" 1 . We 
could have arrived at this directly because G(~f = 0, t) = 
1 implies G(~f — 0, s) = s _1 . This reasoning makes it 
clear that in order to calculate moments, the derivatives 
with respect to one of the 7's evaluated at 7 = must be 
calculated from (|4~5]) before the long time limit is taken. 

Upon taking the nth derivative of (|45f with respect to 
one of the 7's at 7 = 0, the dominant contribution at 
small s is 



5"G( 7 = 0, S ) 



(49) 



5 =° <j|£ a «- l (a?(f - §( 7 = 0,8)) x )p(7 = o)|p(o)> 



We used the fact that at small s, 9™ (f — ^(7 = 0, s)) 
~ s _a ( n + 1 ). B is a diagonal matrix with diagonal ele- 
ments B m . Using Tauberian theorems [13, El], we 
conclude that the moments of the energy and matter 
transfer between the system and the reservoir v will be- 
have at long times as 



(50) 



As noted earlier, these moments are experimentally ac- 
cessible. 

Let us now turn back to the case where no jump oc- 
curred at time zero. We only comment on WTDs with 
a = 1 since only then is it possible to carry out the aver- 
aging procedure described in Sec. [TTJ Since & mm ,(s) S S° 

tmm'/tm' and *mm'( s ) S =" Pram', Eq. flHO]) with a = 1 is 

still valid, perhaps with a different proportionality factor. 

In Appendix [S] we explicitly implement these ideas by 
calculating the moments for a two level quantum dot. 



-W%) m (s)(4> m (s) - 4>' m (s))pm(0)) ■ (48) 

To calculate the long-time behavior of the moments of 
the probability distribution of heat and matter transfer 
between the system and its reservoir, we first consider 
the situation when a jump occurred at time zero. We will 
comment later on situations in which this is not the case. 
In the long time limit, ([45]) diverges at 7 = 0, because 

is singular 

because the determinant of I—P is zero. This can be seen 
by considering the transpose of the matrix (transposition 
does not affect the determinant) and by replacing its first 



V. FLUCTUATION THEOREMS 

We now explore the conditions under which a fluctua- 
tion theorem holds for a CTRW. Two types of derivations 
have been used to obtain steady state fluctuation theo- 
rems for stochastic dynamics. The first relies on a sym- 
metry of the generating function, which translates into 
a fluctuation theorem using large deviation theory as in 
Refs. [13, EH- The other exploits the specific form of the 
logarithm of the ratio of the probability of a trajectory 
and the probability of its time reversed trajectory. We 
will use both for CTRWs and find that they can only be 
considered equivalent under specific conditions. 
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A. Using large deviation 



Here 



This approach to arrive at a fluctuation theorem can 
only be implemented for a — 1 because it requires a finite 
mean waiting time between transitions. We thus restrict 
our discussion to this case. We have seen in Sec. IIII Al 
that as long as one considers WTDs with a = 1, the 
generalized master equation at long times behaves like 
a Markovian master equation and thus reaches a steady 
state. Using the same arguments, we can show that the 
equation of motion (|47p for the generating function be- 
haves at long times as 

||G( 7 ,<)) = W(7)|G(<y,*)>, (51) 



where 



[W(7)] mm ' = W mm > (7,0) for m^m' 
TOUs-J^^O). (52) 



This implies that for long times 



(53) 



where lim^oo ~ In C(7, t) — and where S(-y) is the 

dominant eigenvalue of W(7, 0). This dominant eigen- 
value gives the cumulant generating function because 



5( 7 ) = Urn 7lnG(7,*)- 



(54) 



Note that the derivation to follow does not explicitly re- 
quire the generalized master equation to be equivalent 
to a Markovian master equation at long times; what is 
required is the limiting behavior (|54|) . Furthermore, us- 
ing (f3"3")l , we can verify that (fB"2")) satisfies 



Win) = W\A-f) , 



(55) 



where A = ({f3 u },{—f3 u fj,„}). Since these two matrices 
have the same eigenvalues, this implies the symmetry 



S( 7 ) = S(A- 7 ) . 



(56) 



AS r 



E 



(58) 



represents the change of entropy due to the exchange 
processes with the reservoirs. We note that the change 
in energy and matter can be written in terms of energy 
and matter currents as 



AE (u) 



dTl^(l 



(59) 
(60) 



so that in the long time limit \AE^ and -AN^ corre- 
spond to steady state currents. This is why (|57|) is called 
a current fluctuation theorem [l5j |. 

We now define the matrix W("j) as W(-y) where 7 is 
replaced by 7 = ({j e p v }, {—JmPu^v})- Obviously, when 
replacing W(-y) by W(fy) in our previous results, we cal- 
culate the statistics of AS r . The symmetry ([55"T) now 
implies that W{^f) = W (1 — 7) so that 



5(7) = 5(1 -7) 



(61) 



Using again large deviation theory, we get the fluctuation 
theorem 



Pi |A5 r 



Pi -£AS T 



= e A5 '' for t 



(62) 



In the steady state, the average energy and matter trans- 
ferred with a reservoir v, can be obtained by taking the 
derivative with respect to 7„ at 7 = of the formal so- 
lution of ([51)1. We get 



(Aj?M)/ t = </(")) 



E 

m,m' 



M ss 



(63) 



(AJVM)/t = (#>> = £ (JV m - A^^/C 

m,m' 



Large deviation theory [12], Il5| | can now be applied. 
The limiting behavior (|54[) and the symmetry (|56[) 
then imply the fluctuation theorem for the probability 

pf{-±AEM}, {-±AN^}j for the energy and matter 

currents (cf. below) between the system and the reservoir 
v at long times [H, EH > 



P({iABM},{|AJVM} 



,AS r 



PK-f ASM}, {—■ |AiVM}J 



for i 



(57) 



Current conservation at steady state follows from 



(64) 



If we assume that all M reservoirs (v = 1, . . . , M) have 
different temperatures and chemical potentials, we have 
M — 1 independent nonequilibrium forces associated to 
energy and matter transfer that can be defined as 



X, 



(0 - 



i+1 



(i) 



-/81M1 + A+iM»+i) (65) 



where i = 1, . . . , M— 1. Using (f6"4"|) , the average change in 
the entropy due to exchange processes with the reservoirs 
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(ASV) can be written in the familiar thermodynamical 
form of the entropy production in a steady state 



m(i) 



{AS r )/t 



M-l 

E 

i=l 



(66) 



When < a < 1 , we have seen in section IIII Bl that 
the solution of the GME behaves at long times as a 
power law i~ Q . This will also be the case for the solu- 
tion of the equation of motion for the generating function 
P?)) . Therefore, contrary to the cumulant generat- 
ing function lim^oo j\nG(-y,t) is zero. This indicates 
that the cumulants decay slower than t. The fluctuation 
theorem symmetry is only present in the eigenvalues of 
the generator of the GME (j5Tj) but not in the eigenvec- 
tors. For a = 1, the cumulant generating function is 
given by the dominant eigenvalue, so that the fluctua- 
tion theorem will reflect itself on all quantities relates to 
it (large deviation theory is precisely used to make the 
link between this generating function and the probabili- 
ties). However, in the case < a < 1, there is no way to 
separate in the long time limit, the contribution of the 
eigenvalues from the contribution of the eigenvectors to 
the statistics thus preventing a fluctuation theorem to 
hold. 



B. Using time reversal symmetry 

We denote a forward trajectory of the system between 
times t = and t = T by m r . As illustrated in Fig. [TJ 
at t = the system is in state mo and stays there until 
it jumps to state mi at time n via mechanism v\. It 
remains there until time T2, when it jumps to state m-i via 
mechanism Vi. The trajectory continues in this fashion; 
at time tn there is a jump to state mjv, where the system 
remains at least until time T. The total number of jumps 
in this trajectory is N. The probability of this trajectory 
is 

N-l s 

II 4>%tiL fc+i ^ t *) ) (t - t n ). 



(67) 

The time-reversed trajectory m r starts in state 
at time T, jumps to state mjv_i at time T — tn via 
mechanism vn, and so on. At time T — t\ a jump to state 
mi occurs via mechanism v\, and the system remains 
there until at least time 0. The probability of this time 
reversed trajectory is 

P[fhr] = PmATH^ijT - T N ) 

N-2 x 
II ^mim l+ l( T *+2 -n+l)\(t> ma {Tl)- 

(68) 



mi 



mo 



m 2// m j-2 



m j-l 



Vi-1 



mj niN-1 



tj t 2 % H 



FIG. 1: Representation of a trajectory m^ T y 

Next we consider the quantity 

P[m T ] 



R[m T ] = In 



P[m T ] 



(69) 



whose explicit form reads 
Pm o (0) 



R[m T ] = In 



inn 



Pm N {T) . =1 ^*l imi (r i+ i 

4?io ( T l)4>m N (T -Tn) 



hi 



(T (n) 



(70) 



Because each m T is the unique mirror image of m r , a 
sum over all possible forward trajectories is equivalent to 
a sum over all possible time-reversed trajectories. There- 
fore, since normalization implies that Y]^ P[fh T ] = 1, 
an integral fluctuation theorem follows immediately from 
the definition (|6"9")l . 



( e - R ) =^ e - R Wp[m T ] = 1. 



(71) 



The positivity of the ensemble average of R[m T ], (R) > 0, 
then follows from Jensen's inequality. Using the impor- 
tant property R[m T ] — —R[fh T ], which follows form (|6"9"|) 
together with the fact that by taking twice the time- 
reversal of a trajectory we get back to the original trajec- 
tory m T = m r , we can also derive a detailed fluctuation 
theorem for R, 

P{R) = ^5{R- R[m T ])P[m T ] 
tn T 

= ^<5(i?-i?[m T ])e i? '[ m ^F[m T ] 
= e R J2d(R- R{m r ])P[m T ] 

m T 

= e R ^28(R + R{m T ])P[m T ] 

= e R P(-R) . (72) 

The integral fluctuation theorem (fTTj) and the detailed 
fluctuation theorem (172")) for R are thus completely gen- 
eral and valid for any continuous time random walk. It is 
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worth mentioning that a similar derivation can be done 
for any dynamics as long as each trajectory has a corre- 
sponding time-reversed trajectory with a nonzero proba- 
bility [lOj . 

To make these fluctuation theorems useful, we need to 
give a physical interpretation to R[m T ]. In particular, we 
will argue that R can only be interpreted as a change of 
entropy if two conditions are satisfied. One is that the 
WTDs have a finite first moment (a = 1). The other is 
that they be separable [13,111], that is, that the waiting 
time distributions can be written as the product of a 
waiting time portion that depends only on the originating 
state, and a transition matrix that connects given initial 
and final states, 



'(*) 



(73) 



the separability condition is called "direction time inde- 
pendence" by Qian and Wang [I?], HI])- The first term 
ofEq. TO, 



AS[m T ] ee In = SmN (T) - S mo (0), (74) 

PmsK 1 ) 

where S m (t) = — lnp m (t), can be interpreted as a change 
of system (Gibbs) entropy along the trajectory because it 
depends only on the initial and final microscopic states 
of the system for that trajectory, and the average over 
trajectories is then simply (AS) = S(t) — 5(0), where 
S(t) = Ylm Pm(t)Sm(t) is just a straightforward average 
over states. 

In order to interpret the two remaining terms in (|70|) . 
we implement separability of the WTDs so that 



R[m T ] 



hi 



n 



Pm (0) 
Pm N (T) 

V4 ( T l)<?W( T 



N-l pO« +1 ) 
111 111 



111 



p(«"«+i) 
- T N ) 



m ( T l) 



(75) 



Now only the WTDs of the first jumps remain. In 
Eq. (|72p . the path summation runs over all possible tra- 
jectories including those with or without a jump at time 
zero. One way to handle the problem of having to treat 
the first jump differently from the others is via the time 
averaging procedure (fTU|) in ([6"7) as well as in l[6"8|) . This 
can only be done if the first moments are finite. The 
third term in (|75[) now becomes equal to hi(t mN /t mo ), so 
that using (|27p the second and third terms in (|75|) can 
be combined and R[m T ] can be written in terms of the 
transition matrix elements as 



R\ 



= In 



Pmo(O) 
Pm N (T) 



N-l 0u i+1 ) 



(o) 



(76) 



This form of i?[m r ] is now exactly the same as the 
one derived for the Markovian master equation (l2"9"[) 
(see [3, Hl|). This is a manifestation of the so-called 
corresponding Markov process of a CTRW [48| . 



We denote the second term on the right hand side 
of ([76]) as AS r [m T ] and call it the reservoir part of the 
trajectory entropy because it can be interpreted as the 
change in entropy along the trajectory due to exchange 
processes between the system and the reservoirs. Indeed, 
using (|33p . this term can be expressed as 



AS r 



= m n 



N-l W { Vi+1 ) 



(0) 



Wjiimi+i (0) 



■ A,A£("» [m T ] + AiV<"> [m T ] I ,(77) 



E 



where the change of energy and number of particles along 
the trajectory due to the mechanism v can be expressed 
in terms of heat and matter currents along the trajectory 
as 

AE^[m T ] = f drI^[m T } (78) 
Jo 

AN^[m T ] = f dTl%)[mr] (79) 
J o 

[cf. Eqs. ([59]) and ([BH)) ]. These currents are sequences 
of S functions centered at the times of the jumps and 
multiplied by the corresponding energy or matter change. 
They are positive (negative) if energy or matter increases 
(decreses) in the system. 

We have thus arrived at the important result that 
for separable WTDs with a — 1, R[rn T ] = AS[m T ] + 
AS r [ra T ]. Since AS[m T ] and AS r [m T ] are interpreted 
respectively as the change in the system entropy along 
the trajectory and the change in entropy due to the ex- 
change processes between the system and its reservoirs, 
it is natural to interpret R[m T ] as the total change in en- 
tropy along the trajectory (also called the total change in 
the trajectory entropy production) [UEll- Note that in 
this case the principle of microreversibility, implying that 
at equilibrium the probability of a forward trajectory is 
identical to the probability of its time reversed trajectory 
[i?[m T ] =0], is satisfied if the detailed balance condition 
([3"2"]) is satisfied and if the system is initially at equilib- 
rium [so that p mo (0) = p^ Q and p mjv (T) = ag*]. This 
result is consistent with the findings of Ref. [48| stating 
that separability of the WTDs and detailed balance are 
sufficient conditions for microreversibility to be satisfied 
in a CTRW. 

In Sec. IV Al we showed that a fluctuation theorem for 
AS r can be derived for long times [see Eq. ([6"2"|) ]. In fact, 
considering separable WTDs with a = 1, the fluctuation 
theorem (|62[) can be seen as resulting from the fluctua- 
tion theorem ([72| . as follows. The quantity AS[m T ] is 
a bounded quantity which only depends on the proba- 
bility distribution of the initial and final states of the 
trajectory. On the contrary, AS r [m T ] changes each time 
a jump occurs along the system trajectory. It is there- 
fore reasonable to assume that for very long trajectories 
and for the huge majority of realizations, the contribu- 
tion from AS r [m T ] in i?[m T ] = AS[m T ] + AS r [m T ] will 
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be significantly dominant so that in the long time limit 
([72")) reduces to (1B2")) . However, the derivation of ([(12")) 
only required WTDs with a = 1, but did not require 
separability. The reason for this requirement in order 
to identify Eq. ([72]) as a useful fluctuation theorem for 
all times is that otherwise R[m T ] has no clear physical 
interpretation. The problem is that R[m T ] (and, more 
specifically, the second term in (|7D|) . which according to 
our previous argument dominates at long times) depends 
on the time intervals between the jumps along the tra- 
jectory. This implies that at the level of a single tra- 
jectory, i?[m T ] cannot be expressed in terms of exchange 
processes with the reservoirs (more precisely, in terms 
of time integrated currents). However, the fluctuation 
theorem (|62|) indicates that at long times the probabil- 
ity P(R) to observe a trajectory such that R[m T ] = R 
becomes equivalent to the probability to observe a tra- 
jectory with a set of time integrated currents so that, via 
([58]) . AS r w R. One way to understand this result is 
to coarse-grain the trajectories in time. Instead of spec- 
ifying exactly the time at which each jump occurs, we 
define small time intervals of equal size dt (sufficiently 
small so that the probability of observing two transitions 
in one is interval negligible, i.e., small compared to the 
mean time for a transition to occur). We then specify 
whether a transition between two states occurred or not 
in this interval. In this way, we define coarse-grained 
trajectories (denoted by m T ), and we note that differ- 
ent microscopic trajectories can lead to the same coarse 
grained trajectory. To calculate the probabilities of these 
trajectories, we use the fact that at long times the dy- 
namics is described by ([29)) , which can be discretized in 
time intervals dt. This discretized form allows us to iden- 
tify the probability to stay in a given state m during a 
given time interval with 1 — Ylm' v ^m'm(^)^*) an( ^ tne 
probability to jump from m to m! by mechanism v with 
W^ lm ,(0)dt. Using these probabilities, we can construct 
the probability of a coarse-grained trajectory and that 
of its time reversed coarse-grained trajectory. The log- 
arithm of their ratio gives A5[ra T ] + A5 r [m T ], with the 
same definitions as in (f7i|) and ([77]) , but for rh T instead of 
m T . With the argument that at long times AiSVIVn-r] will 
be dominant, we understand why the fluctuation theo- 
rem (p3%j) holds at long times. One should note that long 
times are also needed in this case to get rid of the con- 
tribution from the initial part of the trajectory where 
([2"9"| is not valid. Also, contrary to the case where sepa- 
rability holds, it is only at the coarse grained level and 
considering very long trajectories that such a dynamics 
can satisfy "microscopic" reversibility. The fluctuation 
theorem (|62p does not result from a probabilistic asym- 
metry under time reversal at the microscopic trajectory 
level as in the case of separable WTDs, but at a coarse 
grained level and only for long times. 

We can finally comment on the case of WTDs with di- 
verging mean waiting times. Even if separability is satis- 
fied, because mean waiting times diverge, (I33[) cannot be 
used to express R[m T ] (or parts of it) in term of exchange 



processes with the reservoirs. The fluctuation theorem 
([72")) is thus valid but seemingly useless. 



VI. CONCLUSIONS 

In this paper we have considered continuous time ran- 
dom walks (CTRWs) in which multiple mechanisms that 
may have different statistical properties induce transi- 
tions between pairs of states. A given energy and num- 
ber of particles can be attributed to each state, so that 
each mechanism can be thought of as corresponding to 
a given reservoir. If these reservoirs have different sta- 
tistical properties, such a CTRW therefore describes the 
stochastic dynamics of an open system. The statistics 
of the transitions between states associated with each 
mechanism are described by waiting time distributions 
(WTDs) . If a WTD decays at long times at least as fast 
as i~ 2 , the distribution has a finite first moment and we 
say that a = 1. If the decay is slower, as t~ a ~ 1 where 
< a < 1, all moments diverge. 

We have analyzed the long-time behavior of the proba- 
bility p m (t) that the system is in state m at time t via the 
generalized master equation for this probability. When 
a = 1 the generalized master equation leads at long times 
to an exponential decay of the probability to a steady 
state, exactly as it would for an ordinary Markovian mas- 
ter equation. If the WTDs corresponding to the different 
mechanisms are different, the steady state is a nonequi- 
librium steady state. If they are identical, the steady 
state distribution corresponds to equilibrium and satis- 
fies detailed balance. On the other hand, if < a < 1, 
the probability p m {t) evolves as a linear combination of 
power law decays t~ a towards the zero eigenvalue mode, 
and the system never reaches a steady state. 

We have presented a formalism to calculate the count- 
ing statistics of the energy and matter transfer in the 
CTRW based on a generating function propagation 
method. By considering systems exchanging energy and 
matter with different reservoirs, we have shown that nth 
moment of the probability distribution to exchange a cer- 
tain amount of energy or matter between the system and 
a given reservoir during a time interval t behaves as t na 
at long times. This result holds for < a < 1 and reflects 
the subordination principle 0, ■ 

Using our generating function formalism together with 
large deviation theory, for WTDs with a = 1 we derived a 
fluctuation theorem for the trajectory quantity AS r [m T ] 
representing the change of entropy along the trajectory 
due to exchange processes with the reservoirs [which can 
be explicitly related to the energy and matter currents 
between the system and the reservoirs ([55)) ]. If P(AS r ) 
is the probability to observe a trajectory along which 
occurs a change AS r [m T ] — AS r , the fluctuation theorem 
reads P(AS r )/P(— AS r ) — exp{A5 r } and is only valid 
at long times. For WTDs with diverging first moments, 
< a < 1, this fluctuation theorem does not hold. 

The trajectory quantity R[m T ] is defined as the loga- 
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rithm of the ratio of the probability of a given trajectory 
to the time reversed trajectory. We have shown that for 
any CTRWs, the ensemble average of R[m T ) is always 
positive and a fluctuation theorem stating that the prob- 
ability P(R) to observe a trajectory such that R[m T ] = R 
is exponentially more likely than to observe a trajectory 
such that R[m T ] = -R, i.e., P(R)/P(-R) = exp{R} 
always holds. Separable WTDs are ones for which the 
state-directional part and the temporal part of the WTD 
factorize [see (|73|) ]. We have shown that it is only for 
separable WTDs with a = 1 that R[m T ] can be inter- 
preted as the change of entropy along the trajectory. In 
this case, this fluctuation theorem is related to the pre- 
vious one because R[m T ] — AS[m T ) + AS r [m T ], where 
AS^to,-] is the change of system entropy along the trajec- 
tory and is bounded, contrary to ASVInv] which typically 
grows for long trajectories. Therefore, for most realiza- 
tions R[m T ] AS r [m T ] at long times, thus providing an 
interpretation of the fluctuation theorem for AS^m,-] in 
terms of probabilistic asymmetry under time reversal of 
the probability of a trajectory. At equilibrium, the sym- 
metry is restored and i?[m r ] — as expected from the 
principle of microreversibility. For nonseparable WTDs 
with a = 1, i?[m r ] can only be related to a change of en- 
tropy after a coarse graining of the trajectories in time. 
The fluctuation theorem for AS r [m T ] still holds, but can 
only be interpreted as a measure of a probabilistic asym- 
metry in time at the level of coarse grained trajectory 
(and also only for long times), and not at the level of 
the microscopic trajectories as in the case of separable 
WTDs. 
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APPENDIX A: SINGLE LEVEL QUANTUM DOT 

As an application of the counting statistics results of 
Sec. IIV1 we consider a single level quantum dot between 
left and a right leads v = L,R. There are two states in 
the system, one corresponding to the empty level m = 
and the other to the filled level m = 1. Since the energy 
transfer between the system and a reservoir is directly 
proportional to the particle transfer in this model, we 
only consider particle transfer. We take separable WTDs, 
specifically 

^oo(7»*) = ^n(7,*) = (Al) 
tfio (7,*) =Pio(7)V'o(*) 
lM7.*)=i%i(7)lM*) . 

where 

Pio(7)=e^ , P 1 ( i) +e ^ , <) 

Po 1 (7) = e-^ ) P W +e -^< ) . (A2) 

Note that 

Po(7 = 0)=P 1 ( o i) +P 1 ( ( f ) = l 
Poi(7 = 0)=P ( 1 L) +P ( f ) = l. (A3) 

We define the affinities A x = \nP^/p[^\ where 
x = L,R, and AA = A L - A R . 

From now on, we focus on the net particle transfer 
between the left lead and the dot so that 7W = 7 and 
ry{R) — 0. We also note that 

fin (7) = e A «P 10 (AA- 7 ) 

P 10 ( 7 ) = e- A «Poi(A^- 7 ) ■ (A4) 

The generating function (|45| for this model reads 



G( 7 , a) = ( &(<) + & (J) {S)PW (7) + P [ s)PMPw (7) Vo (0) + (1 - 0) . (A5) 
V ° l I-P01 ( 7 )Pio(7M>(*#i(s) / 

We can verify that the GF at 7 = diverge as s _1 in the long time limit, and, because of (j A4|l . the same is true at 
7 = AA The first moment reads 

<9 7 G( 7 , s)| 7 =o = — — Vo( s )Po(0) - (1 <-> 0). (A6) 



1 

The WTDs arc taken to be of the form where < a < 1. If a = 1, Bo = to and R>\ =t\. 

Ms) = l-B s a , Ms) = l-B lS a (A7) 



12 



We can now confirm that if < a < 1 and a jump 
occurred at time zero {ip' m {t) = ip m (t)), or if a = 1 and 
a jump occurred at time zero (ip' m (t) — tp m (t)), or if 
a = 1 and we don't know at time zero when the last 
jump occurred (ip' m { s ) = 4>m{s)/t m ), we always get 

9 7 G( 7 , S )| 7=0 - {Bo + Bl)n s >( A8 ) 

where n — 1, 2, 3, . . .. Using the Tauberian theorem, this 
leads to 



a"G( 7 ,t)| T =o 



f— *oo 



r(na + 1) (S + Si)" 
When a = 1, (|A9[) can be written as 



^£(7,^=0' =°° 



(A9) 



i na (AlO) 



where W. 



>(") 



,/t OT / and W„ 



U) 



w. 



(R) 



This is the same result as obtained in Ref. [23|J using a 
Markovian master equation. In can easily be seen that 
(|A10[) vanishes when detailed balance is satisfied. 



Finally, we note that the cumulants calculated from 
these moments all vanish. This indicates that we should 
calculate not only the leading time dependence of the mo- 
ments as we do when applying Tauberian theorems, but 
must retain higher orders to extract information about 
the time dependence of the cumulants. 
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